Coordination via a Relay 

Farzin Haddadpour, Mohammad Hossein Yassaee, Amin Gohari, Mohammad Reza Aref 

Infonnation Systems and Security Lab (ISSL) 

Department of Electrical Engineering, Sharif University of Technology, Tehran, Iran 

Email: {haddadpour,yassaee} @ee.sharif.edu,{aminzadeh,aref } @sharif.edu 

"(N 

^*-< ! Abstract 

>3 , In this paper, we study the problem of coordinating two nodes which can only exchange information via a relay 

at limited rates. The nodes are allowed to do a two-round interactive two-way communication with the relay, after 
which they should be able to generate i.i.d. copies of two random variables with a given joint distribution within 
a vanishing total variation distance. We prove inner and outer bounds on the coordination capacity region for this 
problem. Our inner bound is proved using the technique of "output statistics of random binning" that has recently 
been developed by Yassaee, et al. 

_CJ , 

I. Introduction 

Coordination is the problem of producing dependent random variables over a network |ir|. This problem differs 
CO ' from traditional coding problems where the goal is to distribute explicit messages. The problem of coordination for 

(^ , a joint action has applications in distributed control and game theory ||2], H. Two notions of coordination have 

CS| ' empirical joint distribution of the actions to be close to the desired distribution, whereas in the strong coordination 

we want the total variation distance between the joint probability distribution of the actions, and the i.i.d. copies 
. . , of the given distribution to be negligibly small. In other words, the generated distribution and the i.i.d. distribution 

\—( . should be statistically indistinguishable. These are two different notions of coordination. In this paper we study the 



a 



strong notion of coordination. 

As discussed in ||T|, nodes in a network can cooperate arbitrarily without any communication if they are provided 
with sufficient common randomness. However [[1] argues that problem becomes nontrivial if the action of some of 
the nodes is specified by nature. We believe that this is not the only situation where the problem becomes nontrivial. 
Suppose that two nodes of a network want to cooperate with each other while remaining anonymous to each other. 
They can obtain anonymity through a proxy (relay) who privately exchanges messages with the two nodes. Since 
the two nodes cannot directly talk to each other, they will not be able to directly share randomness. However they 
may attempt to create common randomness indirectly through the relay. But the rate of this common randomness 
will be bounded from above by the communication rate constraints between the nodes and the relay. Furthermore 
creating common randomness for later use may not be the optimal strategy if the final goal is coordination. The 
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Ai Aq A2 

Figure 1. The model for coordination via a relay. In the first step nodes Ai and A2 communicate to the relay node Aq (as in the top subfigure). 
In the second step the relay communicates to Ai and A2 (as in the bottom subfigure). 

communication links between the nodes and the relay are rate limited, and hence there may exist more economic 
ways of using this resource. Inspired by this discussion, we propose the following model as an attempt to understand 
the use of a relay in cooperation of two nodes whose actions are not specified by nature. 

As shown in Fig. [1] we assume that there are four links between the relay {Aq) and the two nodes {Ai and ^2). 
The noiseless forward links from the relay to the the first and second nodes have rates i?/^ and Rf^ respectively. 
The backward links have rates Ri,^ and Rf,^ . As can be seen from the figure, the nodes use the backward Unks first 
to communicate to the relay, after which the relay communicates back to the nodes using the forward links. The 
goal of the two parties is to generate i.i.d. copies of Yi and Y2 jointly distributed according to a given p{yi,y2) 
within a vanishing total variation distance. We don't assume any common randomness shared between Ai and A2 
since the two nodes don't share any resources beyond private communication links with the proxy. However, private 
randomization is allowed at all the three nodes. Further we could have added a separate rate limited public forward 
link from the proxy to all the nodes, where all the bits put on this link will become available to all the parties. 
Adding this link would make our model to resemble the model proposed by Wyner O where a set of random 
bits were being simultaneously transmitted to two parties. However, we have excluded this from our model for 
simplicity. 

Since the two nodes are initially communicating at rates i?^^ and R^^, the nodes can use these only to generate 
pairwise common randomness between themselves and the proxy. Thus one can reinterpret the model as a one-way 
communication problem from the relay to the two nodes in the presence of pairwise common randomness. This 
has been the motivation for naming i?/^ and Rf^ as forward links although they are being used in the second step 
of the protocol. 

It is noteworthy that to see when i?/^ = and R^-^ — 00 our model reduces to the one considered by Cuff in H. 
If i?/j = 0, the first node does not receive any feedback and has to create the i.i.d. copies of Yj" by itself. Since 
Rb^ ~ cxD, the first node can send Y" completely to the relay. The relay is receiving R^^ bits from the second node 
which can be understood as a common randomness shared between Aq and A2. Thus, our problem reduces to the 
problem of E). If Rf-^ — 00, the problem reduces to a special case of the problem studied in [6J. In this case the 
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relay is effectively coordinating with the second node because the relay can send its reconstruction of Y" to the first 
node using the forward Unk Rf^ of infinite capacity. Thus this would be the problem of generating y" and Y,p using 
a two-round communication scheme when the two node share no common randomness. When Ri,-^ = Ri,^ = cx), the 
problem reduces to that of coordinating Ai and A2 when there are pairwise common randomness shared between 
(AqjAi) and (^01^2) but no common randomness shared among the three. Finally when Ri,-^ = Ri,^ = the 
problem reduces to a problem that resembles Wyner's model ||3|. 

We prove an inner and an outer bound on our model. We show that the inner and the outer bound match in 
certain special cases, two of which are of special interest: one is when Ri,-^ — R^^ — 00, i.e. an infinite pairwise 
common randomness, the other is when i?b^ = Ri,^ = 0, i.e. no pairwise common randomness. We show that 
when _R(,j = R^^ = 00, the capacity region is the one where _R/^ + Rf^ is greater than or equal to the mutual 
information between Yi and ¥2- In the other extreme case both Rf-^ and Rf^ have to be larger than Wyner's common 
information. This provides insights on the role of pairwise common randomness. 

This paper is organized as follows: in Section II, we introduce the basic notations and definitions used in this 
paper. Section III contains the main results of the paper, and Section IV and V includes the proofs. 

II. Definitions 
A. Notation 

In this paper, we use p^ to denote the uniform distribution over the set A and p(x") to denote the i.i.d. pmf 
nr=iP(^j)' unless otherwise stated. Also we use Xs to denote {Xj : j G S). The total variation between two 
pmf's p and q on the same alphabet X , is denoted by \\p{x) — q{x)\\-^. When a pmf itself is random, we use capital 
letter, e.g. Px- 

Remark 1: Similar to ||4l in this work we frequently use the concept of random pmfs, which we denote by capital 
letters (e.g. Px)- For any countable set X let A'^ be the probability simplex for distributions on X. A random pmf 
Px is a probability distribution over A"^. In other words, if we use Vl to denote the sample space, the mapping 
a; G O ^^ Px{x\ijj) is a random variable for all x G A" such that Px{x;uj) > and X^x -^-^(^5'^) — 1 ^'^^ ^^1 ^■ 
Thus, uj H- > Px{-;ijj) is a vector of random variables, which we denote by Px- We can definite Px.y on product 
set A" X 3^ in a similar way. We note that we can continue to use the law of total probabiUty with random pmfs 
(e.g. to write Px{x) = J2yPxY{x,y) meaning that Px{x:,uj) = J2y PxY{x,y,uj) for all u) and the conditional 

D^, f ^ meaning that Py iv vyi^,^; — p , — ^ 



probability pmfs (e.g. to write PY\xiy\x) = %l-\l'f meaning that Py|x(y|a;;w) = %^%'^J'^'' for all w). 



B. Problem Statement 

Consider the problem of strong coordination over a network with a relay, as depicted in Figure [T] In this setting, 
there are three nodes Ai, Aq and A2- They do not share any common randomness, but private randomization is 
allowed. Let Mi be the private randomness at node Ai. A (n, Rf-^, Rt,-^, Rf^, Ri,^) coordination code consists of 

• Two encoders at nodes Ak, fc = 1, 2, that map Mk to [1 : 2^^''k]. 

• Two encoders at the relay node Aq, that map Ma x Bi x B2 to [1 : 2^^'fk] for k = 1,2. 

Febraary 24, 2013 DRAFT 



• Two decoders at nodes Ak,k ~ 1,2, that map A^^ x Bfe x J^fc to yj^. 

Definition 1: A joint distribution (7(2/1, j/2) is said to be in the admissible region of the rate tuple [Rf^ , Rbi , Rf2 , Rb2 
if one can find a sequence of {n,Rf\, Ri,-^, Rf^jRi,^) coordination codes for n = 1,2,... whose induced joint 
distributions have marginal distributions p(j/", j/J) '^^at satisfy 



lira 

n— 7-00 



piyl,y2)-Yl<liyh^,y2,^ 



0. 



Definition 2: Given a joint distribution (7(2/1,2/2), the coordination rate region is the closure of the set of rate 
tuples (i?/j , i?(,j , _R/2 , i?(,2 ) that admit the channel g(j/i,2/2)- 

III. Main Results 
Theorem 1 (Inner bound): The following region forms an inner bound to the coordination rate region for q{yi ,2/2): 
TZ\n is the set of all non-negative rate tuples {Rf\, Ri,-^, Rf^, Ri,^), for which there exists p{u,v,w,yi,y2) £ Tm 



such that 



where 



Rb, + Rf, + Rb; + Rf2 > HY1Y2; VUW) + /([/; V\W) + I{W- Y^Y^) 
Rb.+Rf, >I{YiY2;VW), 
Rb2+Rf2>I{YiY2;UW), 

Rf2 + Rf,>I{U;V\W) + IiW;Y,Y2), 



Tin 



(1) 



{p{u,v,w,yi,y2) ■■{Yi,Y2) - 9(2/1,2/2), 

Y2-UW -VW -Yi}. 

Theorem 2 (Outer bound): Take a desired distribution (7(2/1,2/2)- Then the coordination rate region is contained 
in the region TZout which is the closure of the set of all non-negative rate tuples (Rf-^, Rb^^jR/^, Rb2)^ for which 
there exists p{u, v, 2/1,2/2) £ T'out such that 

Rb,+Rh >i{yiy2;V), 

Rb2+Rh>IiYiY2;U), (2) 

Rh + Rfi > max{/(C/; Y,), I{V; Y2)}, 



where 



Tout = {p{u,v,yi,y2) ■■{Yi,Y2) -(7(2/1,2/2), 

Y2-U-Y1, 
Y2-V-Y1, 

\u\ <\yi\ x|:i^2| + i, 

|V|<|yi|x 1^21+1}. 
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Corollary 1: The inner bound and the outer bound match when i?b^ = Ri,^ = oo, both reducing to Rf^ + Rf^ > 
I{Yi;Y2). This corresponds to the case of infinite pairwise common randomness and has not been considered (to 
best of our knowledge) in the previous works. When Rf-^ — oo, the inner and outer bound reduce to Ri,^ + Rf^ 
being greater than or equal to Wyner's common information. The inner and outer bound also match when Rf-^ — 
and i?f,j = cxo. To see this let V — Yi and W — cant, in the inner bound. On the other hand the optimal choice 
for V in the outer bound is V = Yi. Thus both regions reduce to the following region that matches the one given 
inHa. 

Rb,+Rf, >I{YiY2;U), 

Rf,>I{U;Y^). 
Another extreme case is when i?;,^ = R^^ = 0. Here we take U = V ^ cant, in the inner bound. It is easy to 
see that both the inner and outer bound reduce to Rf\ and Rf^ being greater than or equal to Wyner's common 
information. Comparing this case with Wyner's model, we see that an optimal strategy is to send the same message 
to both Ai and A2 (which is expected when Rjj-^ = R^^ = 0). The inner and outer bound also match when 
Yi = [A, B), Yi — (A, C) for mutually independent random variable A, B and C. 

IV. ACHIEVABILITY 

We apply the techniques of |9| to prove the achievability of the theorem. We begin by a providing a summary 
of the lemmas we need. In the following subsection we provide the proof. 

A. Review of probability approximation via random binning ^9^ 

Let (^[i:T] ,Y)he a DMCS distributed according to a joint pmf pxu-t] ,y on a countably infinite set Y[i=i '^i ^ 3^- 
A distributed random binning consists of a set of random mappings Bi : X^ -^ [1 : 2"^'], i G [1 : T], in which Bi 
maps each sequence of Xp uniformly and independently to [1 : 2"^']. We denote the random variable Bt{Xl^) by 
Bt. A random distributed binning induces the following random pmf on the set X,".rp^ x 3^" x nt=i[l ■ 2"^'], 



P(x[l^^],y",6[i:T]) =p{xl,.^T]^y")'[[l{Bt{x^) = h}. 



t=i 



Theorem 3 ([^): If for each 5 C [1 : T], the following constraint holds 

Y,Rt<H{Xs\Y), (3) 



tes 
then as n goes to infinity, we have 



E 



^(y",VT])-p(2/")nP[^:2-*](^*) 



^ 0. (4) 



We now consider another region for which we can approximate a specified pmf. This region is the Slepian-Wolf 
region for reconstructing XJ'^.rp^ in the presence of [Bi-t, Y") at the decoder. As in the achievability proof of the 
Q Theorem 15.4.1], we can define a decoder with respect to any fixed distributed binning. We denote the decoder 
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by the random conditional pmf P"^^(a;M.y, |y", 6[i.x]) (note that since the decoder is a function, this pmf takes 
only two values, and 1). Now we write the Slepian-Wolf theorem in the following equivalent form. See |l9l for 
details. 

Lemma 1: If for each iS C [1 : T], the following constraint holds 



Y,Rt>HiXs\Xs^,Y), (5) 



then as n goes to infinity, we have 



E 



-P(2^fl:T]'y"'j^fl:T]) ~ Pi^ll:T]Ty")'^{^ll:T] " 2;fl:T]} 



0. 



Definition 3: For any random pmfs Px and Qx on X, we say Px ~ Qx if IE \\Px — Qx\\i < £■ Similarly we 
use Px ~ Qx for two (non-random) pmfs to denote the total variation constraint \\px — qx\\i < £■ 
Lemma 2: We have 

1) \\pxPy\x ~qxPY\x\\^ = \\px -qx\\i 
\\px ~qx\\i< \\pxPy\x - qxqY\x\\^ 

e 2e 

2) If PxPy\x ~ QxqY\x^ then there exists x E X such that Py\x=x ~ Qy\x=x- 

3) If Px « Qx and PxPy\x « PxQy\x, then PxPy\x '« QxQy\x. 

B. Proof of Theorem 1 

The proof is divided into three parts. In the first part we introduce two protocols each of which induces a pmf 
on a certain set of rv.'s. The first protocol has the desired i.i.d. property on Y^ and Y2, but leads to no concrete 
coding algorithm. However the second protocol is suitable for construction of a code, with one exception: the second 
protocol is assisted with an extra common randomness that does not really exist in the model. In the second part 
we find conditions on Ri,^ , R^^ , R/^ , i?/2 implying that these two induced distributions are almost identical. In the 
third part of the proof, we eliminate the extra common randomness given to the second protocol without disturbing 
the pmf induced on the desired random variables (Y" and Y^) significantly. This makes the second protocol useful 
for code construction. 

Part (1) of the proof: We define two protocols each of which induces a joint distribution on random variables 
that are defined during the protocol. 

Protocol A. Let (W^jU^jV^jY^jY^) be i.i.d. and distributed according to p{w,v,u, 1/1,1/2) such that the 
marginal pmf of {Yi,Y2) satisfies p{yi,y2) = 9(^1,2/2)- Consider the following random binning: 

> To each sequence w", assign a random bin index gQ G [1 : 2"^°]. 

« To each pair (w;",w"), assign three random bin indices gi E [1 : 2"^'^], 61 £ [1 : 2"^''i] and /i G [1 : 2"^-''i]. 

• To each pair (w", u"), assign three random bin indices 52 G [1 : 2"^^], b2 <E [l : 2"^''2] and /2 G [1 : 2"^f2^, 

m We use a Slepian-Wolf decoder to recover w", u" from {go, gi,bi, /i), and another Slepian-Wolf decoder to 
recover W2,u" from [go, 92,^2, f 2)- The rate constraints for the success of these decoders will be imposed 
later, although these decoders can be conceived even when there is no guarantee of success. 
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The randonu pmf induced by the random binning, denoted by P, can be expressed as follows: 

^(3ok")P(5i6i/ih"i'")P(52?>2/2|if'"w")pK,^;",w") X 

p(yl'|zi;"u")p(2/^>"z;"). 

Protocol B. In this protocol we assume that the nodes have access to the extra common randomness (Go, Gi, 6*2) 
where Gq,Gi,G2 are mutually independent random variables distributed uniformly over the sets [1 : 2"^"], [1 : 
2rii?ij ^jj(j ^i . 2"^2j^ respectively. Now, we use the following protocol: 

• At the first stage, the node Ai chooses an index 61 G [1 : 2"^''i ] uniformly at random and sends it to the node 
Af). Also the node A2 independently chooses an index 62 G [1 : 2"^''2] uniformly at random and sends it to 
the node Aq. 

• In the second stage, knowing (50,31,52, &i, ^2), the node Aq generates sequences (w",?;", u") according to 
the conditional pmf Piw"^ , w", u"|5o, 5i, 52, ^1, ^2) of the protocol A. Then it sends the bin indices /i(u;", w") 
and /2(w",w") to the nodes Ai and A2, respectively. 

• At the final stage, the node Ai, knowing (50, 3i, &i, /i) uses the Slepian-Wolf decoder P"^'^(i()", i)"|5o, ffi, &i, /i) 
to obtain an estimate of (w",t)"). Then, it generates a sequence y" according to pYn\w^v^{Vi\wi jV"^). The 
node A2 proceeds in a similar way. 

The random pmf induced by the protocol, denoted by P, factors as 

P''(5[0:2])P''(^'1)P''(62)P(W",«","",/[1:2]|5[0:2]&[1:2])X 
P^^«,t)"|50,5l,6i,/i)P^^(^2",""l50,<?2,62,/2)x 

p{y-,\w^,ff^)p{y^\w^,u-) (6) 

Part (2) of the proof: Sufficient conditions that make the induced pmfs approximately the same: To find the 
constraints that imply that the pmf P is close to the pmf P in total variation distance, we start with P and make 
it close to P in a few steps. The first step is to observe that 50, (.91, &i) and (52,^2) are the bin indices of w", 
(^",1;") and (^",1*"), respectively. Substituting T ^ 'i, Xi ^W, X2 = WV , X3 = WU and F = in Theorem 
[3] implies that if 

Ro < HiW), 

Ro + Ri+Rb, <H{WV), 

(7) 
Ra + R2+Rb, <H{WU), 

R0 + R1+ R2 + Rb, + Bb2 < H{WVU), 

' The pmf is random because we are doing a random binning assignment in the protocol. 
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then there exists e^"' -> such that -P(5[o:2], &i, ^2) « P^ {g[0:2])p^ {bi)p^ {h) = -P(.g[0:2], &i, &2)- This implies 



(9) 



Pig[0:2],h,b2,w\v\u^,w'i,v",w^,u") « P(g[o.2] , &! , ^2 , w^", t^", u", < , «", u;^\ u") (8) 

The next step is to see that for the Slepian-Wolf decoders of the first protocol to work well, Lemma [1] requires 
imposing the following constraints: 

Ri + Rb, + Rf, > H(V\W), 
R0 + R1+ Rb, + Rf, > H{WV), 

R2 + Rb, + Rf, > H{U\W), 
R0+R2+ Rb2 + Rf2 > H{WU), 
then for some vanishing sequence e" , we have 

-P(ff[0:2],6i,&2,«^",^",u",<,?;",t&^,^") 
Using equation dHJ we have 

4"' +4"' 

The third part of Lemma |2] implies that 

p(g[o.2],&l,fe2,w;^^;^u^^^^;">2^^>(yrl<,*"My2"l^2,"") 

'" « ' PigiO:2]M,b2,w",v^\u-)l{w^ = w-,v- = v^\ w!^ = w;",^" = u"}p(yrK,{>"My2"|z«2",u") 
= Pig[o:2]MM,w-,v-,uni{w^ = w-,v- ^ v-,w^ ^ w-,u- ^ u-}p{y^\w^,v-)piyl^\w^,un. 
Thus, 

P{g[0:2],b,,b2,w\v\u\w'^,v",w^,u",yly^) 

'" « ' P{910:2] , bu 62, w'\ z;", u'\ vl, y^)\{wl = w^, v^ = v",w^ = w^, u" = w"}. 
Using the second item in part 1 of Lemma |2] we conclude that 

Pi9io:2],yi,y2)^"'^^''' P{9l0:2],yi,y2)- 



In particular, the marginal pmf of (V", Y^) of the RHS of this expression is equal to p{yi, yj ) which is the desired 
pmf. 

Part (3) of the proof: In the protocol we assumed that the nodes have access to an external randomness G[o:2] 
which is not present in the model. Nevertheless, we can assume that the nodes agree on an instance 5[o:2] of 
G[o:2]- In this case, the induced pmf P(j/",y2) changes to the conditional pmf ^(y",y2 l.9[0:2])- But if G\q.2] is 
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independent of {Y{\Y^), then the conditional pmf ^(2/",2/2 l5[0:2]) is also close to the desired distribution. To 
obtain the independence, we again use Theorem [3] Substituting T — 3, Xi — W, X2 — WV, X3 = WU and 
Y — Y1Y2 in Theorem |3] asserts that if 

Ro < H{W\Y,Y2), 

Ro + Ri <H{WV\YiY2), 

(10) 
Ro + R2<H{WU\YiY2), 

Ro + Ri + R2< H{WVU\YiY2), 



,(") 



1*--^ / /^r_ _, I'l-ilii''' 1 1'l' \ ■f/-\t- cf^rv^at ^rom c" r»ir\ rr caf-tMi^r\r'i^ tz^ -' 



then P{yi,y2^g[o:2]) ~ P {g[0:2])p{yi ^112)' ^'^^ some vanishing sequence e\ '. Using triangular inequality for 
total variation, we have Piyi,y2,g[a:2]) ~ p'^(5[0:2])p(2/": ^2 )' where e'"' — X]i=o ^i ■ Thus, there exists a 
fixed binning with the corresponding pmf p such that if we replace P with p in ^ and denote the resulting pmf 
with p, then p(y", 2/2 i3[0:2]) ~ P^ {9[0:2])p{yi : J/?)- Now, the second part of Lemma |2] shows that there exists an 

2c(") . _ _ 

instance g[o:2] such that p(y", 2/2 |5[0:2]) ~ p{yi^y2)- Finally, eUminating {Rq, Ri, R2) from (|7]i, (|9]l and ( fTOl i by 
using Fourier-Motzkin elimination results in the rate region ([TJ- 

V. Converse 

Let Q denote a uniform random variable over [1 : n] and independent of all previously defined random 
variables. We choose single-letter auxiliary random variables as follows: U ~ iP2,B2,Y^.Q_^,Q) and V = 
{Fi,Bi,Y^.Q_-^,Q). Using the fact that I{B2]Bi) = that comes from the model (because Ai and A2 are 
creating these random variables at the beginning) we have: 

n{Rf,+Rf,)>H{F2)+H{F^) 

>I{F2\FiBi \B2)+I{B2;Fi \ B^) 

^I{F2B2;FiBi) 

>I{F2B2;Yn 

n 

9=1 

-(1) ■vii)\_T(v(^) 



j:iI(F2B2Y}}l,;YW) IiY}}l,;Y(n 



q=l 



> J2 ^(^2^2^?-!; n^'^) - "51(e) (11) 



9=1 



= nIiF2B2Y}^^_,;Y^'^\Q) - ngi(e), 

> nI{F2B2Yl}^_,,Q; Y^^^) - ngi(e) - ng2ie) (12) 

^nI{U;Y^'^)-ng,{e)~ng2{e), (13) 
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where (?i(e) stands for functions that converge to zero as e converges to zero. Equations (fTTt and (fT2] i hold, due to 
Lemma 20 and Lemma 21 of |5|. In the same way one can show that 

«(% + %)) > nI{V:, ZW) ~ 51 (e) - g2(e). (14) 

Next in a similar fashion we have 

n{Rf,+Rb,) >H{FiBi) 

n 

9=1 

n 

9=1 
_r/y(l) y(2) . y(l)y(2)i 

n 
9=1 

> n/(y; Y^^%'-^) - ngsie) - ng^ie). (15) 

A similar statement can be proved for n{Rf^ + Rb-i)- 

In summary, we have proved that for every e, any achievable rate tuple must belong to the set TZout.e defined as the 
set of all tuples {Rf^,Rf^,Rb^,Rh^) such that there exists p{u,v,yi,y2) G TLut.e for which (i?/^ , i?/^ , i?(,j , i?},^ ) 
satisfies the inequalities ( fT3] ), ( fT4l ) and ( fTSl ) where Tout.e is the set of p{u, v, 2/1,1/2) satisfying the Markov relations 
as in the definition of Tout and 

\\p{yi,y2) -qiyi,y2)\\i < e- 

The proof continues by showing that ne>o7?.out,e = ^out- Note that the cardinality bounds can be proved using the 
standard Fenchel extension of the Caratheodory theorem |]8]. This completes the proof for the converse. 
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